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I propose a general quantum hypothesis testing theory that enables one to test hypotheses about 
any aspect of a physical system, including its dynamics, based on a series of observations. For 
example, the hypotheses can be about the presence of a weak classical signal continuously coupled to 
a quantum sensor, or about competing quantum or classical models of the dynamics of a system. This 
generalization makes the theory useful for quantum detection and experimental tests of quantum 
mechanics in general. In the case of continuous measurements, the theory is significantly simplified 
to produce compact formulae for the likelihood ratio, the central quantity in statistical hypothesis 
testing. The likelihood ratio can then be computed efficiently in many cases of interest. Two 
potential applications of the theory, namely quantum detection of a classical stochastic waveform 
and test of harmonic-oscillator energy quantization, are discussed. 
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Testing hypotheses about a physical system by obser- 
vation is a fundamental endeavor in scientific research. 
Observations are often indirect, noisy, and limited; to 
choose the best model of a system among potential can- 
didates, statistical inference is the most logical way 0, Q 
and has been extensively employed in diverse fields of 
science and engineering. 

Many important quantum mechanics experiments, 
such as tests of quantum mechanics [!, 0| .quantum de- 
tection of weak forces or magnetic fields [fj, and quan- 
tum target detection @, 0] , are examples of hypothesis 
testing. To test quantum nonlocality, for instance, one 
should compare the quantum model with the best clas- 
sical model; Bell's inequality and its variations, which 
impose general bounds on observations of local-hidden- 
variable systems, have been widely used in this regard 
[H, IH • The analyses of experimental data in many such 
tests have nonetheless been criticized by Peres Q: The 
statistical averages in all these inequalities can never be 
measured exactly in a finite number of trials. One should 
use statistical inference to account for the uncertainties 
and provide an operational meaning to the data. 

Another important recent development in quantum 
physics is the experimental demonstration of quantum 
behavior in increasingly macroscopic systems, such as 
mechanical oscillators H3] and microwave resonators 
11 1 . To test the quantization of the oscillator energy 
1C , [TT | , for example, the use of quantum filtering theory 
has been proposed to process the data [12], but testing 
quantum behavior by assuming quantum mechanics can 
be criticized as begging the question. An ingenious pro- 
posal by Clerk et at considers the third moment of energy 
as a test of energy quantization [131 ] . Like the correlations 
in Bell's inequality, however, the third moment is a sta- 
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tistical average and cannot be measured exactly in finite 
time. Again, statistical inference should be used to test 
the quantum behavior of a system rigorously, especially 
when the measurements are weak and noisy. The good 
news here is that the error probabilities for hypothesis 
testing should decrease exponentially with the number 
of measurements when the number is large Q, so one 
can always compensate for a weak signal-to-noise ratio 
by increasing the number of trials. 

Quantum hypothesis testing was first studied by 
Holevo [14| and Yuen et al. [15J- Since then, researchers 
have focused on the use of statistical hypothesis test- 
ing techniques for initial quantum state discrimination 
0, [T(| . Here I propose a more general quantum theory 
of hypothesis testing for model discrimination, allowing 
the hypotheses to be not just about the initial state but 
also about the dynamics of the system under a series of 
observations. This generalization makes the theory ap- 
plicable to virtually any hypothesis testing problem that 
involves quantum mechanics, including tests of quantum 
dynamics Q and quantum waveform detection Q . 

In the case of continuous measurements with Gaus- 
sian or Poissonian noise, the theory is significantly sim- 
plified to produce compact formulae for the likelihood 
ratio, the central quantity in statistical hypothesis test- 
ing. The formulae enable one to compute the ratio ef- 
ficiently in many cases of interest and should be useful 
for numerical approximations in general. Notable prior 
work on continuou s q uantum hypothesis testing is re- 
ported in Refs. [13, Il8j . which study state discrimination 
or parameter estimation only and have not derived the 
general likelihood-ratio formulae proposed here. 

To illustrate the theory, I discuss two potential applica- 
tions, namely quantum detection of a classical stochastic 
waveform and test of harmonic-oscillator energy quanti- 
zation. Waveform detection is a basic operation in future 
quantum sensing applications, such as gravitational- wave 
detection, optomechanical force detection, and atomic 
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magnetometry [f| . Tests of energy quantization, on the 
other hand, have become increasingly popular in exper- 
imental physics due to the rapid recent progress in de- 
vice fabrication technologies [9l4ll|. Besides these two 
applications, the theory is expected to find wide use in 
quantum information processing and quantum physics in 
general, whenever new claims about a quantum system 
need to be tested rigorously. 

Statistical hypothesis testing entails the comparison 
of observation probabilities conditioned on different hy- 
potheses [H, • To test two hypotheses labeled Ho and 
Hi using an observation record Y, the observer splits the 
observation space into two parts Zo and Z\ ; when Y falls 
in Zq, the observer chooses Ho, and when Y falls in Z±, 
the observer chooses Hi. The error probabilities are then 
Poi = J Zo dYP(Y\Hi) and P w = f^dY P{Y\Hq). All 
binary hypothesis testing protocols involve the computa- 
tion of the likelihood ratio, defined as 



A 



P(Y\Hx) 
P{Y\HoY 



(1) 



The ratio is then compared against a threshold 7 that 
depends on the protocol; one decides on Hi if A > 7 and 
Ha if A < 7. For example, the Neyman-Pearson criterion 
minimizes Poi under a constraint on P 10 , while the Baycs 
criterion minimizes aPoi + frPio , a and b being arbitrary 
positive numbers. For multiple independent trials, the 
final likelihood ratio is simply the product of the ratios. 

In most cases, the error probabilities are difficult to 
calculate analytically and only bounds, such as the Cher- 
noff upper bound may be available, but the like- 
lihood ratio can be used to update the posterior hy- 
pothesis probabilities from prior probabilities Pq and 
Pi via P{H X \Y) = PiA/(PiA + P ) and P(H \Y) = 
Po/(P]A + Po) and therefore quantifies the strength of 
evidence for Hi against Ho given Y [![. Generalization to 
multiple hypotheses beyond two is also possible by com- 
puting multiple likelihood ratios or the posterior proba- 
bilities P(Hj\Y) 0. 

Consider now two hypotheses about a system un- 
der a sequence of measurements, with results Y = 
(Syi, . . . , Sum)- For generality, I use quantum theory to 
derive P(Y\Hj) for both hypotheses, but note that a clas- 
sical model can always be expressed mathematically as a 
special case of a quantum model. The observation prob- 
ability distribution is [l9| 



P(Y\Hj) = tr [^(<% M , 

Jj(<fyi,*i)£j(*i)Pi(*o)], 



(2) 



where Pj{to) is the initial density operator at time to, 
Kj(tm) is the completely positive map that models the 
system dynamics from time i m _i to t m , Jj{5y m ,t m ) is 
the completely positive map that models the measure- 
ment at time t m , and the subscripts j for Pj{to), K.j, and 
Jj denote the assumption of Hj for these quantities. 
To proceed, let t m — to + mSt and assume the following 



Kraus form of Jj for Gaussian measurements [19|, |2C 
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where Qj is the noise variance of the inherent quantum- 
limited measurement, Sj is the excess noise variance, Cj 
is a quantum operator depending on the measurement, 
and o(St) denotes terms asymptotically smaller than St. 
The map becomes 



J 1 (Sy,t)p = P(Sy) 



Sy ( i 
2R^ P + PC ^ 



St 



— hcjpc] ~ c]c jP - pc]c 3 ) + o(St) 



P(Sy) 



V2wRSt 



exp 



Sy 2 \ 
2RSt J 



R = Qj + 5j 



(4) 



I assume that the total noise variance R is independent of 
the hypothesis to focus on tests of hidden models rather 
than the observation noise levels. P(Sy) then factors out 
of both the numerator and denominator of the likelihood 
ratio and cancels itself. 

Taking the continuous time limit using Ito calculus 
with Sy 2 = RSt + o(St), the likelihood ratio becomes 
A = tr/i/tr/o, with fj obeying the following stochas- 
tic differential equation: 



dfj = dtCjfj 
dt 



an \^ c ih c j c j c jfj fi c j c i 



(5) 



and Cj being the Lindblad generator originating from JCj . 
Equation ([5]) has the exact same mathematical form as 
the linear Belavkin equation for an unnormalized filter- 
ing density operator [21|, but beware that fj represents 
the state of the system only if Hj is true; I call fj an 
assumptive state. 

To put A in a form more amenable to numerics, con- 
sider the stochastic differential equation for tr fj : 



d tr fj = tr dfj 
where 



dy 
2R 



tr 



( c j7j + fj c f) = ^tMj tr /jj ( 6 ) 



t'j 



tr 



'fj 



(T) 



is an assumptive estimate; it is the posterior mean of 
the observable (cj + c|)/2 only if Hj is true. The form 
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of Eq. ([6]) suggests that it can be solved by taking 
the logarithm of trfj, i.e., dlntr/j = (dtr/j)/tr/j — 

(dtrfjf /2(tr/ J ) 2 = dypj/R - dtjj?J2R, resulting in 



dy 



lntr/ J (T)= / JL N - / — M ; 



la 



dt 



2R' 



(8) 



with the dy integral being an Ito integral. A becomes 



A(T) = exp 



to 



dy 
R 



(Mi - Mo) ~ 



dt 
2R 



A) 



(9) 



This compact formula for the likelihood ratio is the quan- 
tum generalization of a similar result by Duncan and 
Kailath in classical detection theory [22| . Generalization 
to the case of vectoral observations with noise covari- 
ance matrix R is trivial; the result is simply Eq. © with 
dypj/R replaced by dy T R~ 1 pj and p^/R by pj R~ 1 pj. 

For continuous measurements with Poissonian noise, a 
formula for A can be derived similarly (23[: 



A(T) = exp 



t 

dy In 

i ' Mo 



dt{pi - p ) 



M., 



trf 
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dfj = dtCjfj + {dy - adt) [—Cjfjc] - f. 



-3 J 3 

dt 



(10) 
(11) 

(12) 



where < r/j < 1 is the quantum efficiency, a can be any 
positive number, and Eqs. (|11[) and (1121) form a quantum 
filter for Poissonian observations [20|, |21| . Equation (p~0|) 
generalizes a similar classical result by Snyder [24j ]. 

Equations © and (fTU]) show that continuous hypoth- 
esis testing can be done simply by comparing how the 
observation process is correlated with the observable es- 
timated by each hypothesis, as schematically depicted in 
Fig.ffl 



Observations 

dy 
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FIG. 1: (Color online). Structure of the likelihood-ratio for- 
mulae given by Eqs. and (llOjl . 

Since Eqs. © and © or Eqs. ((TTJ» and {HJ have the 
same form as Belavkin filters, one can leverage estab- 
lished quantum filtering techniques to update the esti- 
mates and the likelihood ratio continuously with incom- 
ing observations. If fj has a Wigner function that re- 
mains Gaussian in time, the problem has an equivalent 



classical linear Gaussian model }19h21| conditioned on 
each hypothesis, and pj can be computed efficiently us- 
ing the Kalman-Bucy filter, which gives the mean vector 
and covariance matrix of the Wigner function. The clas- 
sical model also enables one to use existing formulae of 
Chernoff bounds for classical waveform detection [25[ to 
bound the error probabilities. It remains a technical chal- 
lenge to compute the quantum filter for problems without 
a Gaussian phase-space representation beyond few-level 
systems, but the quantum trajectory method should help 
cut the required computational resources by employing 
an ensemble of wavefunctions instead of a density matrix 
[l9l |26| . Error bounds for such nonclassical problems also 
remain an important open problem. 

As an illustration of the theory, consider the detection 
of a weak classical stochastic signal, such as a gravita- 
tional wave or a magnetic field, using a quantum sensor 
5], with "Hi hypothesizing the presence of the signal and 
Ho its absence. Let a; be a vector of the state variables for 
the classical signal. One way to account for the dynam- 
ics of x is to use the hybrid density operator formalism, 
which includes x as auxiliary degrees of freedom in the 
system [l8|, [l^,^. The initial assumptive state /i(£o) 
becomes p(to)P(x, to), with p(to) being the initial density 
operator for the quantum sensor and P(x 7 t ) the initial 
probability density of x. Equation ([5]) for f\ becomes 



dfi = dtCi(x)fi 
dt 



dy 
2R 



cfi + Act) 



(20/1^ - cVi - /ic f c) 



(13) 



with /j 1 = J dxtr[(c + c t )/i/2]/ J dxtr/i. C%(x) should 
include the Lindblad generator for the quantum sensor, 
the coupling of x to the quantum sensor via an inter- 
action Hamiltonian, and also the forward Kolmogorov 
generator that models the classical dynamics of x 20] . c 
is an operator that depends on the actual measurement 
of the quantum sensor; for cavity optomechanical force 
detection for example, c is the cavity optical annihilation 
operator or can be approximated as the mechanical posi- 
tion operator if the intracavity optical dynamics can be 
adiabatically eliminated [28(. 

For the null hypothesis Hq , the classical degrees of free- 
dom need not be included. /o(to) is then p(t ), Eq. © 
becomes 



df = dtCofo + % (c/o + /oc f ) 

+ ^ (2c/ ct - cVo - /oc f c) 



(14) 



and Co includes only the Lindblad generator for the quan- 
tum sensor. In most current cases of interest in quantum 
sensing, the Wigner functions for fo and f± remain ap- 
proximately Gaussian 0, [2(|. Kalman-Bucy filters can 
then be used to solve Eqs. (flB"]) and (fT4)l for the assump- 
tive estimates, to be correlated with the observation pro- 
cess according to Eq. © to produce A, and existing for- 
mulae of Chernoff bounds for classial waveform detection 
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[25| can be used to bound the error probabilities. Ref. [23[ 
contains a simple example of such calculations. 

Quantum smoothing can further improve the estima- 
tion of x [2(| in the event of a likely detection. Although 
smoothing is not needed here for the exact computation 
of A, it may be useful for improving the approximation of 
A for non-Gaussian problems when the exact estimates 
are too expensive to compute [29l |. 

As a second example, consider the test of energy quan- 
tization in a harmonic oscillator. To ensure the rigor of 
the test, imagine a classical physicist who wishes to chal- 
lenge the quantum harmonic oscillator model by propos- 
ing a competing model based on classical mechanics. To 
devise a good classical model, he first examines quadra- 
ture measurements of a harmonic oscillator in a thermal 
bath. With the harmonic time dependence on the os- 
cillator frequency removed in an interaction picture, the 
assumptive state f± for the quantum hypothesis "Hi obeys 



dfi 



(iV+l)(2a/ 1 at- a t a / 1 _/ ia t a ) 

dy 



+ N (2a) ha - aa) f t - froa!) } + ^ (c/i + he) 



+ ^(2c/ lC -c 2 /i-/ic 2 ) 
c = q cos 9 + p sin 9, 



(15) 
(16) 



where a = (q + ip)/^/2 is the annihilation operator, q and 
p are quadrature operators, c is a quadrature operator 
with 9 held fixed for each trial to eliminate any compli- 
cating measurement backaction effect, 7 is the decay rate 
of the oscillator, and N is a temperature-dependent pa- 
rameter. This backaction-evading measurement scheme 
can be implemented approximately by double-sideband 
optical pumping in cavity optomechanics (fj l30j . 

An equivalent classical model for the quadrature mea- 
surements is 



7. 



dx\ = x\dt 

2 



yfydWi, dx 2 = 

dy = h(xi, X2)dt + dV, 
h = x\ cos 9 + X2 sin 9. 



~x 2 dt + y^fdW 2 , 

(17) 
(18) 



where x\ and x 2 are classical Ornstein-Uhlenbeck pro- 
cesses and dW\, dW 2 , and dV are uncorrelated classical 
Wiener noises with dWl = dWl = (N + l/2)dt and 
dV 2 = Rdt. One can make fo diagonal and embed it 
with a classical distribution go {x\, x 2 ) to model classical 
statistics; the equation for the classical assumptive state 
5o is 



jdt 

d9n = — 



{xigo) + {x 2 go) 



N+- 



d 2 g d 2 g 
dx\ dx\ 



dy. 



(19) 



which is a classical Duncan-Mortensen-Zakai (DMZ) 
equation [3lJ. The assumptive estimate fin = 
J dxidx 2 hgo/ J dxidx 2 go should be identical to the quan- 
tum one, as can be seen by transforming h to a Wigner 
function and neglecting the measurement backaction that 
does not affect the observations. A given the quadra- 
ture observations then stays at 1, confirming that the 
two models are indistinguishable. 

In a different experiment on the same oscillator, the 
energy of the oscillator is measured instead. Let 



a) a + aa 



(20) 



which can be implemented approximately by dispersive 
optomechanical coupling in cavity optomechanics 
[l2| . h still obeys Eq. (fT5|) . but with c now given by 
Eq. (|20p and different R and Q. The measurements are 
again backaction-evading, as the backaction noise on the 
oscillator phase does not affect the energy observations. 

Given the prior success of the classical model, the clas- 
sical physicist decides to retain Eqs. (|17[) and modifies 
only the observation as a function of x\ and x 2 : 



h = 



(21) 



The DMZ equation given by Eq. (fl9l) . assuming contin- 
uous energy, should now produce an assumptive energy 
estimate different from the quantum one; it is this dif- 
ference that should make the likelihood ratio increase in 
favor of the quantum hypothesis with more observations, 
if quantum mechanics is correct. Previous data analy- 
sis techniques that consider only the quantum estimate 
12] fail to take into account the probability that the ob- 
servations can also be explained by a continuous-energy 
model and are therefore insufficient to demonstrate en- 
ergy quantization conclusively. The non-Gaussian nature 
of the problem means that bounds on the error proba- 
bilities may be difficult to compute analytically and one 
may have to resort to numerics, but one can also use A 
as a Bayesian statistic to quantify the strength of the 
evidence for one hypothesis against another [1|. 
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Appendix A: Supplementary Material 

This document contains a derivation of the likelihood-ratio formula for continuous quantum measurements with 
Poissonian noise in Sec. I A H and an example of quantum optomechanical stochastic force detection in Sec. IA 21 



1. Likelihood-ratio formula for continuous Poissonian measurements 

The completely positive map for a weak Poissonian measurement is given by 

Jj($y)p= P{Sy\Sz)iSzc jP c]5t+(l-Sz) p- 5 -^{c]c jP + pc\cj) j, 
«z=o,i ^ L J J 

where Sy, 8z £ {0, 1} and 

P{8y\5z) = (1 — Sy)(l — rjjSz) + r/jSySz 
models the effect of imperfect quantum efficiency < rjj < 1. Rearranging terms (20j . 

5t 



J j (6y)p = P(8y) 



P{5y) = (1 - Sy)(l - aSt) + SyaSt, 
where P(5y) is a reference probability distribution and a is an arbitrary positive number. This gives 

tr/x 



A 



tr/o' 



dft = dtCjfj + y (2 Cj f jC \ - cfafi - fjcfc) + (dy ~ adt) (^r,fj< : ] - fj) 



(Al) 

(A2) 

(A3) 
(A4) 

(A5) 
(A6) 



Equation (| A6|) coincides with the quantum filtering equation for an unnormalized posterior density operator fj given 
Poissonian observations dy [20j. Next, consider 



dtifj = tr dfj = (dy - adt) (— - l) to fj 



(A7) 
(A8) 



where p,j is the filtering estimate of the observable rjjCjCj assuming that the hypothesis Hj is true. Expanding d In tr fj 
in Taylor series, 



dlntr/,=£ 



(-1) 



n+l 



-(dtr/i)" 



l»(tr/i)' 



With (dy — adt) n = dy n + o(dt) for n > 2 and dy n = dy for Poissonian observations, 



d In tr /j = dy In — — dt (fij — a) , 

lntr/, (T)= / dy In dt(n 3 
J to a J t 



a) , 



A(T) = exp 



T /-T 

dyln — - / - /i ) 

to ^0 "'to 



(A9) 
(A10) 

(All) 
(A12) 

(A13) 
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2. Quantum optomechanical detection of a Gaussian stochastic force 

Let F — Cx be a classical force acting on a moving mirror with position operator q and momentum p, and a; be a 
vectoral classical Gaussian stochastic process x described by the Ito equation 



dx = Axdt + dW, dWdW T = Bdt. 



(A14) 



The mirror is assumed to be a harmonic oscillator with mass m and frequency uj and part of an optical cavity pumped 
by a near-resonant continuous-wave laser. The phase quadrature of the cavity output is measured continuously by 
homodyne detection, with an observation process given by dy. For simplicity, I assume that the optical intracavity dy- 
namics can be adiabatically eliminated, the phase modulation by the mirror motion is much smaller than 7r/2 radians, 
such that the homodyne detection is effectively measuring the mirror position, and there is no excess decoherence. 
Under hypothesis Hi, the force is present and the quantum filtering equation for the unnormalized hybrid density 
operator fi(x,t) is then given by |20j 



dfi 
Ci(x)fi 
Hi(x) 



dtCi(x)fi + ^(qfi + fiq) 
- l -[Hi{x),h]+C c (x)h, 



dt 
8R 



(2qf iq - q 2 fi - fiq 2 ) 



P 

2m 



qCx, 



2 *-~> dx u dx u 



(Bftvfi) , 



(A15) 
(A16) 
(A17) 
(A18) 



where R is the measurement noise variance that depends on the laser intensity and the cavity properties and C c {x) is 
the forward Kolmogorov generator for the classical process x. Under the null hypothesis Ho, the force is absent and 
the filtering equation for the oscillator density operator f is 



df = dtCofo + 2^ (ifo + hi) + ^ ( 2 g./o<7 - q 2 fa - foq 2 



A)/o 
H 



P 

2m 



These filtering equations can be transformed to equations for the Wigner functions of fj : 

1 

1 



gi(q,p,x,t) = — / du(q-u/2\f 1 (x,t)\q + u/2)exp(ipu/h), 



5o(g,P,0 = ^ / du(q-u/2\f (t)\q + u/2)exp(ipu/h), 



dg 3 = dtC'^gj 



dy 
R 



19 j, 



£'idi = £ c (x)gi + dt 

L go = ^ h muj q-^— 



P dgi ( 2 n ,dgi 

^- + {mu m q - Cx) — 

m oq op 



ti 2 d 2 gi 

m~dp T 



rn 



2 dgo , fr 2 d 2 g 
mui q- 



dp 8R dp 2 



(A19) 
(A20) 
(A21) 

(A22) 
(A23) 
(A24) 
(A25) 

(A26) 



where q and p are now phase-space variables, p is seen to suffer from measurement-back-action-induccd diffusion, and 
£[ has the form of a forward Kolmogorov generator for a new Gaussian process z — (q,p, x T ) T : 



c'Mz, t) = _ £ J?_ [(Jiz)^] + 



d 2 



dz 



2 ^ dzudzv 



(Si/M/fli) 





( o 


1/m 







— raw 2 





c 




V o 





A 









h 2 /AR 








B 



(A27) 
(A28) 
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with denoting zero matrices. Similarly, under Ho, we have z = (q,p) T and 



Jo 



d 

1/m 
—muj 2 



dzudzy 



{So^vdo) 



So — 





ft 2 /4.R 



(A29) 
(A30) 



The Gaussian statistics mean that we can use Kalman-Bucy filters to compute the filtering estimates of the mirror 
position fij given dy [20| : 



tfej = JjZjdt + Tjidy - Kjz'jdt), Kj = (1,0,..., 0), 
dE,- 



= ^ + - >:,/v, R a\>: ; + 

and the likelihood ratio becomes 

" ^ ' T dt 



A(T) = exp 



(A31) 
(A32) 

(A33) 
(A34) 

(A35) 



Given the Gaussian structure of the problem under each hypothesis, we can use known results about the Chernoff 
upper bounds for classical waveform estimation to bound the error probabilities [25[ : 



Pio < exp \p(a) - ai\ > 
Poi < exp [fi(s) + (1 - s)j] 



1 

2R 



dt 



to 



(A36) 
(A37) 

(A38) 



where < s < 1, 7 is the threshold of the likelihood-ratio test, is the q variance component of E,-, which obeys 

Eq. (|A33|) . and E g (s, t) is the variance of \fsqo + y/1 — sqi for a different filtering problem, in which observations of 
\fsqo + yl — sqi are made with noise variance R and qj has the statistics of q under Hj, viz., 

dt 



dt 
J 



= JE + E J T - tK T R- 1 Kt T 



S 



S, 



Jo 








Ji 



So 








Si 



K 



( v/i I ) , E 9 



KYiK 



(A39) 
(A40) 



The tightest upper bounds are obtained by minimizing the bounds with respect to s. If x and therefore q are stationary, 
Yij and E will converge to steady states in the long-time limit, and the Chernoff bounds will decay exponentially with 
time. I 



